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Abstract 

In  this  report  we  discuss  the  dynamics  of  heterogeneous  TCP  systems  with  propagation  delays.  Instead  of 
studying  the  local  linearized  TCP  dynamics,  we  study  the  global  stability  conditions  and  obtain  the  stability  regions. 
Also  we  provide  proof  of  periodic  behavior  of  a  single  TCP  connection  when  stability  conditions  are  not  met. 


I.  Introduction 

Today’s  Internet  traffic  is  mostly  consisted  of  flows  based  on  TCP  which  provides  reliable  transmission  and 
resilient  performance  in  response  to  varying  network  conditions.  TCP,  as  a  window-based  end-to-end  control 
scheme,  adapts  the  sender’s  transmission  rate  by  the  feedback  information  of  the  receiver.  The  sender  exploits 
the  available  network  network  by  linearly  increasing  the  window  size  and  when  a  network  congestion  is  detected 
from  either  packet  drop  or  ECN  marking,  the  sender  reduces  the  window  by  half.  Using  TCP  fluid-flow  model, 
with  such  additive-increase-multiplicative-decrease  window  control  algorithm,  coupled  with  the  AQM  scheme  in  the 
intermediate  routers,  we  can  formulate  the  network  as  a  nonlinear  delay  feedback  system.  The  dynamical  behavior 
of  such  system  has  been  studied  in  [1],  [2],  [3],  [4],  [5],  [6],  and  etc.  Due  to  the  nonlinearity  of  the  system  and  the 
existence  of  delay  in  the  feedback,  people  either  focus  on  the  small  signal  linearized  system  in  the  neighborhood 
of  equilibrium  state  [5],  or  use  Lyapunov-Razumikhin  type  theorems  to  analyze  single  source  and  single  bottleneck 
network  [3],  [4],  Recently  people  start  to  use  powerful  nonlinear  stability  analysis  tools,  such  passivity  theory  and 
ISS  Small-Gain  theorem,  to  obtain  robust  stability  conditions  for  network  flow  control  problems  [7]  [8],  but  it  is 
very  difficult  to  apply  these  tools  to  the  TCP  systems  since  TCP  is  not  an  ISS  system.  This  work  tries  to  establish 
global  nonlinear  stability  conditions  for  a  general  AQM  scheme  and  study  the  dynamical  behavior  of  a  simple 
TCP  system  when  the  stability  conditions  are  not  met.  The  paper  is  organized  as  follows.  Section  II  proves  global 
stability  theorems  for  heterogeneous  TCP  systems.  Section  III  proves  the  existence  of  periodic  dynamics  for  a 
single  source  and  single  bottleneck  TCP  system  with  delay.  We  conclude  in  Section  IV. 


II.  Global  Stability  of  TCP  systems 


We  are  considering  here  a  network  of  TCP  sources  and  links  as  in  the  Figure  (1)  with  N  sources  and  L 
links.  Packets  from  each  source  i  flow  at  the  rate  of  r,  £  M;V  through  the  link  j  with  the  aggregated  arrival  rate 
Uj  =  [Rr\j  £  Ml.  And  accordingly  each  link  generates  a  penalty  value  pj  £  from  the  arrival  rate  and  its  queue 
size  and  sends  the  penalty  value  back  to  the  sender.  Then  each  sender  adjusts  its  sending  rate  appropriately  by  the 
aggregated  penalty  value  q,  =  \  R1  p]  ,  £  M;V  it  receives.  Here  matrix  R  is  the  routing  matrix  and  we  assume  it  is 
constant.  Also  another  assumption  here  is  that  the  aggregated  penalty  value  is  the  summation  of  the  penalty  values 
from  related  links  rather  than  multiplication,  which  is  a  fine  approximation  when  the  penalty  values  are  small. 
Notice  that  the  system  is  nonlinear,  and  we  allow  different  delays  in  the  routing  matrix.  In  this  study  we  wish  to 
establish  conditions  for  global  stability. 

The  system  dynamics  takes  the  form  of  the  following, 
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where  Cj  is  the  link  capacity  at  the  link  j,  and  r.,  is  the  link  delay  seen  by  the  source  i.  The  above  equations 
describe  the  scenario  in  which  the  router  drops  the  incoming  packets  by  some  schemes  instead  of  just  marking 
them.  First  of  all  we  transform  Equation  (2)  into 


Pj  =  1  ~Pj)Vj  ~cj),  j  =  !,■■■, L. 


(3) 
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Fig.  1 .  Network  of  TCP  system 


Here  Hj(pj)  =  hj(hJ1(jpj)).  Under  some  mild  conditions,  Equations  (2)  and  (3)  are  equivalent.  So  we  instead 
study  the  dynamical  system  with  state  equations  (1)  and  (3).  The  delay-free  case  can  be  solved  by  Lyapunov’s 
direct  method.  Here  “global”  means  the  region  where  rq  >  0,  i  =  1, . . . ,  N,  and  pj  e  [0, 1],  j  =  1, . . . ,  L.  We  begin 
with  a  simple  observation: 

Lemma  1:  The  states  of  the  dynamical  system  described  by  Equations  (1)  and  (3)  are  uniformly  bounded. 

Proof:  We  only  need  to  consider  rf  s.  We  designate  cm  =  max)=i  ,_/\  Cj.  Without  loss  of  generality  suppose 
there  is  a  to  such  that  rft)  <  ry(fo)  =  2 cm,  for  all  t  <  to  and  n  is  still  increasing.  Then 


Pj  =  Hj(pj)((  1  -  pj)yj  -  Cj)  >  Hj(pj)(  1  -  2 pj)cM,  j  e  Ci 


for  all  t  at  which  rff)  >  2 cm-  So  pj  peaks  at  least  at  1/2  and  surpasses  any  //,  q  £  (0, 1/2)  in  finite  time  tv.  Thus 
we  have 

nit)  <  2cm  +  max{^iyUT}  +  Vt 

which  completes  the  proof.  ■ 

Proposition  1:  If  Hj  is  bounded  away  from  0  for  all  j,  the  delay-free  (r,  =  0,  i  =  1, . . . ,  Ar)  TCP  system 
described  by  Equations  (1)  and  (3)  is  globally  asymptotically  stable. 

Proof:  In  the  following  proof,  i  is  the  index  from  1  to  N  and  j  is  the  index  from  1  to  L.  Let  us  define 
displaced  state  variables  fj  =  r*  —  r*  and  f>j  =  pj  —  p*,  where  r*  and  p*  are  the  rate  of  the  zth  source  and  the 
dropping  probability  at  the  jth  link  in  equilibrium  state  respectively.  Also  we  designate  r  =  \f  i, . . . ,  r.y]7  and 
p  =  [pi.... , pi]T .  So  the  dynamical  equations  becomes 


We  define  Jj(-)  as 


n  =  ~  (  2^  +  rM  Wi  ~  \di  2  +  2r*? 


Pj  =  ~  Pj)Vj  ~  VjPj) 


Qi 


jju\  A  {  Jo]  l/Ht(Pj  +  y/x)dx,  u>  0 

|  /“  1  /Hj(pj  -  sfx)dx1  u  <  0 


(4) 

(5) 


It  is  easy  to  see  that  since  Hj(u )  >  0  for  all  j  and  u  is  defined  on  a  compact  set,  those  integrals  are  well  defined, 
continuously  differentiable  and  positive  definite. 
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Next  consider  the  candidate  Lyapunov  function 

x  ~  dS  +  f\/2 


V(r,p)  =  ~r 
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Take  the  derivative  along  the  trajectory  of  the  dynamical  system,  we  get 

N  L 

V  =  ^2(d~2 +f2/2)-1riri  +  ^2(1-pj)-1jj(qj) 
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From  the  fact  that 


(6) 


ri/2  +  n  =  n/2  +  n/2  >n/2 

yj  =  X  ri  -  0 

i£Cj 

Qi  =  X  pi  ^  °> 

jeSi 

we  know  that  the  derivative  of  V (f ,  q)  is  positive  semidefinite  and  since  the  only  invariant  set  is  at  the  equilibrium, 
so  global  asymptotic  stability  follows  from  Invariance  Theorem.  ■ 

Remark  1:  The  above  Proposition  considers  the  AIMD  form  of  TCP.  Actually  by  using  similar  Lyapunov 
technique,  one  can  prove  that  for  the  fluid-flow  model  of  general  TCP  window  update  algorithm  like: 

(  Wk  +  aW^a ,  packet  received 
k+1  \  Wk  —  bW^ ,  packet  loss 


global  asymptotic  stability  still  holds. 
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Next  we  consider  the  case  when  there  are  no  delays  from  the  feedbacks  of  the  penalty  information,  but  there  are 
state  delays  in  the  rate  dynamics,  which  is, 


hit) 
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Proposition  2:  If  Hj  is  bounded  away  from  0  for  all  j,  the  TCP  system  described  by  Equations  (7)  and  (3)  is 
globally  asymptotically  stable. 

Proof:  For  any  initial  conditions  rj(#j)  =  ffO/),  ffO/)  >  0,  9i  G  [— Tj,  0],  and  pj{ 0)  =  pjo,  there  is  a  solution 
Ti{t)  and  Pj{t)  for  Vf  >  0. 

Let  us  study  a  particular  trajectory  of  such  solution.  Define  functions  :  M+  x  M+  — »  M+  such  that 


7  /  a  A  f  ffT  hi))  T  Hia ^-fi(6)=X,0<6<t 

,l  ’  \  n,  fi{9)  f  x,0  <  6  <  t 
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and  define  functions  (j  :  M+  x  M+  — >  M+  such  that 

f{  +  x ,  36,  st.O  <  6  <t,  ri{6)  =  x 
?i,  fi{9)  f  <  6  <  t 


C i(x,t)  = 


Observe  that  the  discontinuity  with  regard  to  t  in  fix,  t)  takes  place  only  at  x  =  fit)  and  df{x,t)/dt  =  0  for  all 
other  x’s  .  So 

rm  d&(x,t) 


rr 

Jo 


dt 


-dx  =  0 


Consider  the  functions  Wi(t)’ s 


I  1  rffty  d  f>Q 

)  2  Jo  &(y7,t)ax’  '>u 

1  rh(t)2  C tVMdx  f  <  0 

2  Jo  €i(-Vx,t)  ’ 
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First  of  all,  the  above  integrals  are  well  defined  for  all  f,  f  £  (0,  oo)  since  the  integrands  are  nothing  other  than 
rt it) /r,; (t  —  Tf)  or  1  and  the  integral  can  be  written  as 


< 


1  ri(t)2  c i(±\/x,t)  dx 

2  Jo  £i(±(y/x,t)  dt 

t  t+  \ 
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dt 
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d2  -  2ri  (P  )dt<(l  +  di  )rMt 


1 0  nit-Ti ) 

where  is  the  upperbound  of  the  rate.  Second,  since  rft)  remains  positive  all  the  time  so  Vly- ( 7 )  ’ s  are  positive 
definite  functions.  And  the  derivative  of  Wft)  s  are 

~  U\~  n{t)  ,  1  fri{t)2  d  &(±y/x,t)  j 
nit-Ti )  2  J0  dtfi±fx,t) 

=  -if i/2  +  fi)qixl  -  idf2  +  r2j2)qifi 

Therefore  the  positive  definite  function 

“  di2  +  fl/2  n  _1 
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1-pi 


+  r]v/2 

-1 


[W1(t),...,WNi  f)]J 


J- PL 
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has  the  derivative 


V(t)  =  —rT  diag 


fj/ 2  +  Tj 

df  +  #f  /  2 


Qi 


r  —  fr  diag 


Vi 


P- 


1~Pj. 

Since  V(t)  is  always  non-negative  and  decreasing  with  time,  so  lim^oo  V(t)  exists.  From  boundedness  of  the 
trajectory,  V(t)  and  V(t)  is  bounded.  Thus  by  applying  Barbalat  lemma,  lim/^oc  V(t)  =  0.  Because  V(t)  is  a 
positive  definite  function  of  rfs  and  pfs,  so  it  follows  that  the  dynamical  system  converges  to  its  equilibrium  state. 


The  previous  theorem  establishes  that  in  the  source  dynamics,  the  delay  term  of  the  sending  rate  is  not  the  cause  of 
instability.  So  we  should  study  the  effect  of  delayed  feedback  to  the  global  stability.  It  is  a  very  difficult  problem 
even  in  a  single  flow  scenario.  By  using  Lyapunov-Razumikhin  type  theorems,  previous  studies  (  [4],  [3])  gave 
very  narrow  stability  regions.  This  is  because  in  the  source  dynamics  the  gain  of  the  delayed  term  can  be  large  and 
the  gain  of  the  delay-free  term  can  be  small.  Also  Razumikhin  type  methods  often  give  rather  poor  stability  region 
estimates  for  delay-dependent  stability.  Here  we  try  to  utilize  a  more  sophiticated  Lyapunov  functional  to  obtain  a 
much  better  stability  region  estimates. 

Due  to  complexity  of  the  problem  we  face,  we  only  present  a  single-flow  scenario  with  a  linear  queue  marking 
function.  Consider  a  TCP/AQM  dynamics  described  as  below, 

r  =  ~ — — —  -^r(t)2kq(t-r), 
q  =  (; r-C)+ , 


r  and  q  are  TCP  rate  and  bottleneck  queue  size  as  usual  and  k  is  the  slope  of  the  marking  function.  By  re-scaling 
the  time  t  =  ts  to  normalize  the  delay,  we  get 

f  =  —  — — —  —  r(f/2  +  C)kq(s  —  l)f(s) 

rq* 

q  =  rr.  (10) 

Here  we  let  r  =  r*  +  r  and  q  =  q*  +  q,  where  r*  =  C  and  q*  =  fc-1((  1  +  C2r2/ 2)  are  equilibrium  rate  and 
queue  length  respectively.  We  have  the  following  result. 

Theorem  1:  Suppose  tC  A>  1,  we  can  choose  k  to  make  the  system  (10)  globally  stable. 

Proof:  Local  linear  stability  result  in  Lemma  2  tells  us  when  tC  A>  1,  we  can  choose  k  =  4C  :!r~:i  to  obtain 
local  stability.  For  simplicity,  let  us  denote  ijj(t)  =  \r(t).  q(t)]  T .  Also  denote  r/  as  a  2x2  matrix-valued  function 
with  bounded  variation  on  [—1,0]: 

MO  0;  0  0],  s  =  — 1 

77(s)  =  [0  —  t~1  /q*\  0  0],  — 1  <  s  <  0 

\  [— rCkq*  —  t~x /q*]T  0],  s  =  0 

It  is  easy  to  see  that  the  linearized  version  of  (10)  can  be  written  as 

Wt)  =  J  dri(d)i/tt(6). 

From  [9],  we  can  choose  the  following  Lyapunov  functional  for  (10), 


V(f)  = 

+ 

+ 

x 


V>T(o)y(o)v>(o) 


2^t(o) 


Y  {—u  +  6)drj(u),f{6)d0 


dsf>T  (s)dr]T  (h) 

Y(—s  +  h  —  u  +  0)drj{u)'f{9)d6 


(11) 


It  is  known  that  if  (10)  is  locally  stable,  we  can  find  Y  G  C([—  1,  l],R2x2)  satisfies  y(0)  +  YT(0)  =  —  W  where 
W  is  a  positive  definite  matrix.  Here  Y (0)  is  defined  as  d+Y(0)/dt.  Then  V(;ip)  is  positive  definite  if  Y  satisfies 
additionally: 
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(i)  Y (t)  is  continuously  differentiable  for  t  /  0. 

(ii)  Y (0)  is  symmetric  and  Y(t)  =  YT(—t). 

(iii)  Y(t)  =  dr]T(s)Y (s  +  t). 

Take  the  derivative  of  V (ip)  we  can  show 

Vip  =  -i’T(0)Wip(0)  -  2kT(f(0)q(-l) /2  +  q(-l)C) 
x  (f(0)g(0)Yi2(0)  +  f(0)2yn(0)) 


Denote  Y (t)  =  [y\  y2 ;  2/3  2/4] ■  From  the  conditions  at  which  Y (t)  has  to  satisfy  we  have 


m(t)  2/2 (t) 

—kCq*T  t 

yi(t)  y2(t) 

1 

1 - 

O 

O  ’ 

2/i(l  —  t)  2/2(1  —  t) 

_  2/3 (t)  m(t) 

0  0 

.  2/3 it)  2/4(t) 

“T 

L  0  J 

.  2/3(1  -t)  2/4(1  -f)  _ 

We  can  solve  the  above  equation  explicitly.  By  some  calculation,  yi(t)  is  the  solution  of  the  following  fourth- 
degree  differential  equation, 

s<4>  -  kV rVV2)  -  =  0. 

Given  initial  condition  2/1  (0)  =  —1/2,  a  solution  of  the  above  equation  is 

Vi(t)  = 

where 


u  = 


1  (■ u 2  +  kCTq*u)e~ut  -  g*~ 

2 u  u2  +  kCrq*u  T  q*~1e~u 


k2C2T2q*2  I  k^C^r^q*4  1 

2  +V  4  +7 


It  is  easy  to  see  that  when  tC  1,  u  =  \j2j(rC)  and  y\(t)  =  (1  —  t)/ 2.  We  can  also  deduct  the  following 
relations, 

2/3(1)  +  =  2/3(0), 

rq* 

and  for  y(0)  +  FT(0)  =  -  W  =  -[Wi  W2;  W2  W4], 

f  2y(0)  =  — 1, 

l  -kCrq*y2(0)  +  ry4( 0)  -  (rg*)_1yi(l)  =  W2, 

(  -2{rq*)-ly^l)  =  W4. 


So  we  can  set  y2(0 )  =  2/3(0)  =  r  xq*  ,  and  choose  2/4(0)  properly  so  that 


W  = 


-1 


0 


0 - 

rzq*z 


<  0. 


Now  V(ip)  becomes 


V(ip)  =  -r(0y-2r  /q*q(0)  -  2kr(r (0)q(—l)/2  +  q(-l)C) 

x  (^Tf(°)^(°)  +  Jf(0)2)- 

/  (Jj  £ 

Suppose  q  is  confined  in  the  region  [0,mCr],  for  any  positive  integer  m.  We  can  upperbound  the  above  equation 
by 


v(ip)  < 


-m2  -  ^m2  +  f(0)(f(0)/2  +  2q(0)/(rq*))  >  0 

-r(0)2  -  ^m2  -  (2mC  +  r(0)(m  +  l/2))«(^i  +  «),  f(0)(f (0)/2  +  2g(0)/(rq*))  <  0. 


rg* 


(12) 

We  can  observe  from  Figure  2  in  Region  I  and  Region  III  the  upper  condition  of  (12)  is  satisfied  and  V(ip) 
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1\ 


III 


=cr 


ri 


2 


Fig.  2.  Region  of  in  (12) 


becomes 


V(il>)  <  -f(0)2  - 


q-2q*2 


m 5 


4f(0)  f(0)  2q(0) 


-( 


+ 


=  — (1  —  2(C'r)~i)f(0)2  — 


Ct 

2 


/j-2  ^^2  ^  /y- q^2 


rq 

4 


-) 


?(°)  +  — ^r(0)q(0) 


The  last  part  of  the  above  equation  is  strictly  below  zero  when  ^  is  other  than  0  if  the  condition 


2  \  2  16 
Ct  )  q*2  >  q *4 

holds.  This  is  true  from  our  assumption  Ct  1. 

In  Region  II  and  Region  IV  of  Figure  2,  the  maximum  value  of  V (V)  should  be  reached  for  f  >  0  (Region 
II).  This  is  because  for  every  r  and  q  in  Region  IV,  we  can  choose  —  r  and  —q  in  Region  II  so  that  the  right 
handside  of  (12)  in  the  second  situation  is  larger.  This  argument  can  be  immediately  verified  from  the  existence  of 
the  (2 mC  +  f(0)(m  +  1/2))  term.  So  now  let  us  focus  on  Region  II.  The  part  which  involves  q  is 

-  ( 2mC  +  f(°)(m  +  V2)))  ' ®(°)- 

This  reaches  maximum  in  Region  II  at  q(0)  =  0.  So  we  showed  in  Region  II  and  IV  we  also  have 


i /(VO  <  0. 


Therefore  we  conclude  that  in  all  regions  of  the  state  space,  the  derivative  of  the  Lyapunov  functional  (11)  is  strictly 
below  0  except  when  the  trajectory  is  at  the  equilibrium  state.  Consequently  global  stability  holds.  ■ 


III.  Periodic  Solution  of  a  Single  TCP  Connection 

Now  we  study  a  single  TCP  source  with  the  round-trip  time  R  and  go  through  a  bottleneck  link  with  fixed 
bandwidth  C.  The  bottleneck  router  is  implemented  with  some  ECN  marking  scheme.  We  have  the  following 
dynamics, 

dr  =  1  -  f(g(t  -  t))  r(t  -  t) 

dt  t2  r(t) 

-  ^ r(t)r(t-T)f(q(t-T )) 

=  (r-C)+ 


dq 

dt 


(13) 
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The  function  f(q)  e  C'1(M,  [0, 1])  is  a  nondecreasing  marking  function  satisfying  the  following  constraints 

f(q )  =  0  ,  for  q  <  0 

f{q )  =  1  ,  for  q>B.  (14) 


From  observations  of  simulations,  we  notice  that  dynamics  (13)  has  periodic  solutions  when  the  delay  t  is  greater 
than  a  certain  value.  Low  [5]  proved  that  the  condition  of  stability  of  linearized  version  of  (13).  In  this  section,  we 
try  to  prove  some  properties  of  nonlinear  dynamics,  including  boundedness  and  periodic  behavior  of  the  solution. 

First  of  all,  we  want  to  derive  the  local  behavior  of  the  system  (13)  when  the  delay  r  is  near  the  boundary 
of  the  stability  region  established  from  the  linearized  system.  To  begin  with,  we  need  to  obtain  the  local  stability 
conditions  with  regard  to  r.  The  linearized  version  of  Equations  (13)  is 


dr 

dt 

dq 

dt 


-/'(«*)  (f  +  l r-2)  q(t  -  t)  -  r*/(Of(t) 


Here  we  let  r  =  r*  +  r  and  q  =  q*  +  q,  where  r*  =  C  and  q*  =  f  1((l  +  C2R2 / 2)  X)  are  equilibrium  rate  and 
queue  length  respectively.  Re-scale  the  time  t  =  ts  to  normalize  the  delay,  we  get 


*  =  -vmq(s~ ]  ~ T/(?  1  (5) 

dq 

—  =  rr. 

ds 

The  following  lemma  holds. 

Lemma  2:  Suppose  f'(q*)  <  0.5006  and  let  t &,  k  =  {0, 1}  be  the  solutions  of  the  following  equation, 


(15) 


cot 


COS  iOk 


=  f\q*)(l+tlC2/2), 


(16) 


and  uiq,  oo \  be  respectively  the  first  and  the  second  smallest  positive  oo  <E  [0,vr/2]  satisfying 

oo4  tan2  uo 


COS  00 


00‘ 


f(q*)  + 


2 f{q*)  cost o 


=  1. 


(17) 


If  fo  <  t  <  ti,  then  all  the  characteristic  roots  A(r)  of  Equations  (15)  have  negative  real  parts.  There  is  an  infinite 
series  7>,  k  =  0, 1, . . .,  such  that  there  are  exactly  2  pure  imaginary  roots  when  r  =  r/;.  A(r)  is  differentiable  at 
r  =  ti,  and  ReA^fi)  >  0.  If  f{q*)  >  0.5006,  the  system  (15)  is  unstable  for  all  r.  For  r  >  t\,  there  are  precisely 
two  characteristic  roots  A  of  Equations  (15)  in  the  region  ReA  >  0  and  —  tt  <  ImA  <  n. 

Proof:  The  characteristic  equation  of  Equation  (15)  is 


A(A)  =  A2  +  rf(q*)CX  +  y^ye“A  =  0. 
Suppose  Equation  (18)  has  pure  imaginary  roots  joo,  then 


rf(q*)C 

/V)V 

/(?*)  ) 


wtanw 

oo4  +  T2f(q*)2C2oo2. 


Substitute  equality  (19)  into  (20),  we  immediately  get 

f(q*)  =  oo1 

f(q*)  cos  oo 


(18) 


(19) 

(20) 


(21) 


Multiply  this  with  (19)  and  after  some  calculations  we  obtain  Equation  (17).  This  indicates  that  the  pure  imaginary 
roots  of  Equation  (18)  do  not  depend  on  f(q*)  whose  value  is  decided  by  the  delay  r.  Further  examination  of  the 
signs  of  real  and  imaginary  terms  of  the  equation  tells  us  that  all  possible  positive  pure  imaginary  roots  of  Equation 
(18)  can  only  lie  in  the  intervals  [27c7t,  27c7t  +  7t/2],  k  =  0. 1, . . ..  For  sufficiently  large  k,  the  first  term  in  the  left 
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hand  side  of  (17)  can  be  small  at  2kir  and  the  second  term  is  zero.  So  there  is  a  smallest  positive  solution  to  the 
equation  (17)  and  we  denote  it  ojq.  There  is  a  sequence  of  positive  pure  imaginary  roots  {ion\,  t on  <  un+ 

For  each  uik,  the  value  of  r  such  that  (19)  and  (20)  hold  can  be  easily  deducted.  For  to  and  t\  the  result  is 
in  Equation  (16)  and  the  rest  is  the  same.  We  will  show  that  at  each  r  there  are  at  most  2  pure  imaginary  roots 
possible.  Assume  the  contrary  holds.  Then  there  exist  lo\  and  uj'2  such  that  (20)  and  (21)  both  hold  for  some  r. 
Therefore 


COS  Wi 


sin  LU-, 


1 


_ /V) 

r2f(q*)2C 2  f(q*) 


cos  w. 


sin  u)0 


Since  cos  0/  sin2  0  is  monotone  for  0  £  [2kn  +  7r/2],  so  ut[  =  2kir  +  u'2.  It  is  obviously  not  possible  for  any  k  ^  0 
by  checking  (20).  Therefore  at  each  r  there  are  at  most  2  conjugated  pure  imaginary  roots. 

By  applying  Theorem  13.9  of  [10]  we  know  that  the  necessary  and  sufficient  condition  that  all  roots  of  A(A) 
reside  to  the  left  of  the  imaginary  axis  is 


where 


Crf(q*)2  ^  sin  a 
/'(<f)  "  a 

(22) 

cota -on,-)' 

(23) 

It  can  be  observed  that  for  all  o’s  that  satisfy  (23),  we  only  need  to  check  the  restriction  of  (22)  for  a  £  [0,  tt], 
since  sin  a/ a  is  a  monotonically  decreasing  function.  For  convenience  denote  b  =  Ct,  we  have  from  (23) 

b  =  a”1  cot  a  ±  y  a-2  cot2  a  —  2 

for  a  £  [0,0]  C  [0,  vr/2]  where  cot  0/0  =  2.  Thus  after  some  calculations  (22)  is  the  same  as, 

cot  a  /cot2  a 


/'(?*) 


*\-i 


for  r  <  \/2  / C  and 


/V) 


*\-l 


> 


> 


cos2  a 
a3  sin  a 


cos2  a 
a3  sin  a 


cot  a 


-2 


cot2  a 


-2 


(24) 


(25) 


for  r  >  v/2/C. 

The  right  hand  side  is  lower  bounded  away  from  0  for  a  £  [0,0].  We  calculated  numerically  its  minimum  as 
1.9976  and  we  denote  the  delay  r  at  this  moment  as  n  whose  value  is  n  =  0.8355/C.  Consequently  there  is  an 
upper  bound  equal  to  /3q  A  0.5006  for  f'{q*)  so  that  there  exists  stability  region  for  r.  Therefore  by  properties  of 
a  with  regard  to  r  and  Theorem  13.9  in  [10]  we  obtain  the  stability  region  described  in  Figure  3.  So  we  see  that 
if  f{q*)  <  An  the  system  is  stable  at  Vr,  t  £  [to,ti]  for  some  to,  t\. 

It  is  easy  to  observe  that  there  are  no  roots  of  (18)  having  the  form  A  =  u  +  in.  Otherwise  the  imaginary  part 
of  (18)  implies 

u  =  -Crf(q*)/2, 


and  the  real  part  of  (18)  becomes 

0  =  u2  -  7T2  +  \ 

=  -jC2r2/(,-)2  -  <  0. 

This  is  a  contradiction.  Since  u>\  <  n,  applying  Rouche’s  theorem,  it  can  be  shown  that  there  are  two  roots  in  the 
region  of  ReA  >  0,  —  -k  <  ImA  <  tt  for  Vr  >  t\. 
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/'(?•) 


A 


Unstable  Region 


Ti 


T 


Fig.  3.  Stability  region  of  (15)  with  regard  to  r  and  f'(q*) 


Suppose  A  =  u  +  iv  is  the  solution  and  denote  w  =  1  / f(q*).  It  follows, 

u2  —  v2  +  Ctw~1u  +  f'(q*)we~u  cos  v  =  0 
2  uv  +  Ctw~1v  —  f'(q*)we~u  sin  v  =  0. 


Differentiating  the  above  equations  with  regard  to  w  we  get 


and 


(2 u  +  Ctw  1  —  f'(q*)we  ucosv)—— 


dw 


(IV 

—  (2v  +  f'(q*)we~u  sin  v)  — 


Ctu 


-  f  ( q*)e  u  cos  v, 


(2 v  +  f'(q*)we  “sinn) 


dw 


du 

dw 


+  (2 u  +  Ctw  —  f'(q*)we  ucosv) 


dv 

dw 


Ctv 


w* 


+  f  (q*)e  u  sinn, 


From  the  Implicit  Function  Theorem,  A(ro)  is  continuously  differentiable  with  regard  to  w  (equivalently  with  regard 
to  r)  and  from  some  calculations  the  sign  of  ReA'(fo)  is  the  same  as  the  sign  of 


wf'(q*)2  +  2CTV2w  2  +  CTf'(q*)vw  1sinn 
+  2vf'(q*)  sinn  —  f'(q*)rCw~1  cos  v. 


(26) 


But  at  r  =  ti,  v  =  ui,  using  the  relation  (16)  it  follows 

f'{q*)CTW~ 1  cos  v  =  vf'(q*)  sin  v. 

Substituting  this  back  to  (26)  we  obtain  ReA'(fi)  >0  ■ 

Theorem  2:  Equations  (13)  has  a  Hopf  bifurcation  at  t\,  where  t\  is  defined  in  Lemma  2. 

Proof:  According  to  [11]  in  order  to  prove  Hopf  bifurcation  point  it  is  sufficient  to  check  the  following  two 
conditions, 

1)  The  linear  equations  (15)  has  a  simple  purely  imaginary  characteristic  root  Ao  =  iv o  f  0  and  all  characteristic 
roots  A j  f  Ao,  Ao,  satisfy  A j  f  m\o  for  any  integer  m. 

2)  ReA'(ro)  +  0. 

And  from  Lemma  2  both  conditions  are  automatically  satisfied.  ■ 
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Theorem  2  can  be  interpreted  as  the  local  solution  to  Equations  (13)  when  r  is  closely  above  t±  is  periodic  with 
period  close  to  See  [11]  Theorem  11.1.1  for  exact  statement. 

To  prove  the  existence  of  global  periodic  solution  is  equivalent  to  prove  the  invariant  solution  under  an  infinite 
dimensional  operator.  The  basic  idea  is  to  use  Schauder  Fixed  Point  Theorem.  To  avoid  trivial  constant  solution, 
certain  criterion  called  ejectivity  (  [11],  [12])  has  to  be  checked. 

Definition  1:  Suppose  X  is  a  Banach  space,  U  is  a  subset  of  X,  and  x  is  a  given  point  in  U.  Given  a  map 
A  :  U\  {x\  — ►  X,  the  point  x  €  U  is  said  to  be  an  ejective  point  of  A  if  there  is  an  open  neighborhood  G  Cl 
of  x  such  that  for  every  y  S  G  C\U,  y  fi  x,  there  is  an  integer  m  =  m(y )  such  that  Amy  G  n  U. 

Periodic  solution  for  infinite  dimensional  problems  is  studied  by  examining  the  mapping  of  a  closed  convex  set, 
usually  a  cone,  its  boundedness  and  ejectivity  under  such  mapping.  So  we  list  some  useful  tools  (Theorem  3  and 
Theorem  4  for  convenience  [11]. 

For  any  M  >  0,  denote  Sm  =  {x  €  X  :  |x|  =  M},  and  Bm  =  {x  G  X  :  |x|  <  M}. 

Theorem  3:  If  K  is  a  closed  convex  set  in  X ,  A  :  K  \  {0}  — >  K  is  completely  continuous,  0  E  K  is  an  ejective 
point  of  A,  and  there  is  an  M  >  0  such  that  Ax  =  Ax,  x  E  K  n  Sm  implies  A  <  1,  then  A  has  a  fixed  point  in 
K  n  Bm  \  {0}  if  either  K  is  infinite  dimensional  or  0  is  an  extreme  point  of  K. 

Suppose  L  :  C  — >  Mn  is  linear  and  continuous,  /  :  C  — ►  is  completely  continuous  together  with  a  continuous 

derivative  f  and  /( 0)  =  0,  /'( 0)  =  0.  Consider  two  equations 

x(t)  =  Lxt  +  f(xt) 

y(t )  =  Lyt  (27) 


For  any  characteristic  root  A  of  the  above  equation,  there  is  a  decomposition  of  C  as  C  =  Pa  ©  Q\,  where  P\ 
and  Q\  are  invariant  under  the  solution  operator  T jfit)  of  the  above  equation,  =  yfifi),  f  E  G.  Fet  the 

projection  operators  defined  by  the  decomposition  of  C  be  tt\,  I  —  tt\  with  the  range  of  tt>  equal  to  F\.  Now  we 
have  the  following  conditions  [12]  to  check  the  ejective  point. 

Theorem  4:  Suppose  the  following  conditions  are  fulfilled: 

(i)  There  is  a  characteristic  root  A  of  Equation  (27)  satisfying  ReA  >  0. 

(ii)  There  is  a  closed  convex  set  K  C  C,  0  €  K,  and  5  >  0,  such  that 

v  =  v(5)  =  inf{|7TA0|  :  €E  K,  \  fi\  =  <5}  >  0 

(iii)  There  is  a  continuous  function  r  :  K\  {0}  — >  [a,  oo],  0  <  a  such  that  the  map  defined  by 


M  =  xt  (<£)(»,  fieK\{  0} 

takes  K  \  {0}  into  K  and  is  completely  continuous. 

(iv)  Given  G  C  C  open,  0  6  G,  there  is  a  neighborhood  V  of  0  such  that  xt(-‘,4>)  G  G,  if  <p  G  V  n  K,  and 
o<t< 

Then  0  is  an  ejective  point  of  A. 

In  next  two  lemmas  we  prove  the  boundedness  of  rate  r(t)  and  queue  size  (fit).  Note  that  the  function  f(q)  is 
only  a  marking  function,  so  it  is  not  trivial  to  show  q(t)  is  bounded. 

Lemma  3:  Denote  Ci  >  C  as  the  solution  to 

t2C  (Ci(1  —  (Cr)-1)  —  C)2  _  n 


and  C*2  as  the  solution  to 


Cl  -  C 2 
2  C2  T 


=  2. 


Fet  Cm  =  xasiyi{Ci,C2iC / (1  —  (Cr)-1)}.  Then  for  any  initial  conditions,  there  exists  a  finite  time  tM  such  that 
Vf  >  tM,  r(t)  of  Equation  (13)  is  less  than  Cm- 

Proof:  Suppose  at  some  time  t\,  r(tfi)  =  Cm-  Due  to  the  continuity  of  r(t),  we  can  define 


to  -  sup{f0|r(f0)  <  C,  t0  <  h} 
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and  r(to)  =  C.  We  note  that  from  (13), 

which  is  equivalent  to 

So  it  follows, 


dr  r(t  —  t ) 
dt  ~  r2r(f) 


dr 2  r(t  —  t) 

<  2  — - 


dt 


r(tY  —  Cz  <  — t  /  r(s  —  r)ds 

T~  Jto 


<  —CMit  —  to). 

Thus  the  time  the  trajectory  takes  from  to  to  ft  is  lower  bounded  by 

2  /m2 

*  ^  \  L  _2 

Cl  ~  SO  >  - — - T 


2  Cm 


It  can  be  easily  shown  that  since  Cm  >  C2,  t  —  to  >  2r. 
In  addition,  we  know  that  Vt  G  [to  +  r,  ti], 


dr(t)  <  CM 


(28) 


dt  t2C 

It  follows  that  r(ti  —  r)  >  Cm  (l  —  (Cr)_1).  In  real  applications,  since  there  are  always  more  than  one  packet 
flowing  in  the  network,  so  Cr  >>  1.  Therefore  the  lower  bound  of  r(t\  —  t)  is  always  positive.  We  want  to  obtain 
the  following  lower  bound  for  the  bottleneck  queue  size  at  time  t\  —  T\ 

rti—r 

Is. 


q(h  ~r)  >  f  ( r(s )  -  C)ds 


Since  r(t)  is  a  continuous  function  with  upper  bounded  first  derivative  (28),  it  turns  out  that  the  lower  bound  for 
q(ti  -  t )  is 

(Cm  (1  -  &)  -  cf 
2Cu/(t2C) 

From  our  assumption  we  know  that  the  above  expression  is  no  less  than  B  and  the  marking  function  f(B)  =  1. 
So  we  have 


rYi) 


r(h  -  t) 


1-(1  + 


t  r2r(ti) 

r(h  -  r)  r2r(C)2 
r2r(fi)  2 

<  0. 

Therefore  the  rate  r(t)  can  not  increase  beyond  Cm- 

The  previous  proof  applies  to  the  situations  where  r(t)  <  Cm,  for  t  €  [to  —  r,  to].  In  general  case,  from  previous 
deduction  we  know  that  the  queue  size  will  reach  B  if  the  rate  r(t )  exceeds  Cm  after  rising  from  C.  It  will  remain 
above  B  until  the  rate  r(t)  falls  below  C.  But  there  is  a  delay  r  from  the  queue  to  the  sender.  Consequently  the 
rate  r(t)  will  stay  below  C  for  the  period  of  at  least  tau  to  return  back  to  C.  Therefore  there  always  exists  a  time 
tM  such  that  r(tM)  =  C,  r(t)  <  CM,Yt  G  \pM  ~  T,  Cm]  and  the  upper  bound  applies  after  time  tM-  ■ 

Lemma  4:  We  define  q  m  as 

B  +  (CM  -  C)t  +  2  ( %  -  In  %  -  1 


.  C  C 

where  Cm  is  the  same  as  in  Lemma  3.  Then  Vi,  t  >  tM,  where  tM  is  also  defined  in  Lemma  3,  q(t)  <  qm- 
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Proof:  From  Lemma  3  we  know  that  Vi,  t  >  tM,  r(t)  <  Cm-  We  only  consider  this  range  of  t  in  this  proof. 
Suppose  q(to)  =  B.  We  know  that  for  t  >  to  +  r, 

dr(t)  r(t)r(t  —  r) 

dt  2 

until  for  some  t\  such  that  r{t\)  =  C.  Since  r(fo)  >  C  as  we  showed  in  the  previous  proof,  it  follows, 


So, 


dr(t)  ir‘(t)C 
dt  ~  2 

r(t)  <  CWe_C(t_to_T)/2, 


,  ,  2  CM 

ft  -  to  -  t  <  —  In  — 

Therefore  the  traffic  accumulation  at  the  bottleneck  queue  from  t o  +  r  to  t\  is  upper-bounded  by 

f1  (CMe"C(t"to"r)/2  -  C)dt 
J  t0+T 

<  (29) 

The  traffic  accumulation  from  to  to  to  +  r  is  upper-bounded  by  (Cm  —  C)r.  Combine  this  and  (29)  we  obtain  the 
claim  of  this  lemma.  ■ 

Consider  Equations  (13),  let  Co  =  C([— r,  0],M)xK  and  denote  elements  in  Co  by  =  (</>, a),  f  E  C([— r, 0], R), 
a  G  M.  For  any  e  Co,  Equations  (13)  has  a  unique  solution  xff),  xt  =  (rt,q(t  —  R )),  through  i/)  at  zero.  Let 
A"  =  {?/>=(</>,  a)  G  Co  :  0  <  a  <  oo,  0  =  </>(— r)  >  0(0),  —A  <  0  <  0}. 

Lemma  5:  Suppose  marking  function  f(q)  satisfies  conditions  (14),  then  there  exists  a  continuous  function 
Ti  :  K  \  0  — >  (r,  oo),  such  that 

xTRi>){^)  e  -  {-^  :  ^  e  A}. 

And  there  exists  a  continuous  function  T2  :  —  A  \  0  — >  (2r,  00),  such  that 

e  A 

Proof:  If  the  function  Ti  exists,  and  from  Equations  (13)  we  see  that  the  solution  xff)  is  transversal  to  the 
q-axis  at  t  =  T\  (C),  so  it  immediately  follows  that  7)  (A)  is  continuous  from  the  continuity  of  the  solution  with 
respect  to  the  initial  conditions.  So  we  will  prove  the  existence  of  the  function  T\.  The  function  T2  can  be  proved 
in  a  similar  way.  To  study  the  behavior  of  the  solution  of  Equations  (13)  x{i)')  for  f  <E  A,  we  analyze  its  curve  in 
the  (r,  g)-plane.  Denote 

T  =  {(r,q)  €  M2  :  1  ^  ^ r2f(q )}. 

Because  of  the  properties  of  f(q),  T  is  a  curve  that  starts  at  (— C,B  —  q*),  passes  (0,0),  and  converges  to  —  q* 
when  r  — »  00  in  the  (r,  q)-plane. 


Fig.  4.  Trajectory  of  Periodic  Solution  of  Equations  (13) 
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Suppose  x(0)  =  ip(0)  is  above  T.  Denote  t\  =  min{£|x(£)  G  r,t  >  0}.  We  will  show  U  is  finite.  As  long  as 

x(t )  remains  above  T,  r(£)  =  r(t  —  r)r(t)-1  ((1  —  f{q{t  —  r)))r-2  —  r(t)2 f(q{t  —  r))/ 2)  <  0,  and  q{t  —  r)  = 

r(t  —  t)  <  0.  If  x{t )  never  intersects  T,  we  have  q(t  —  r)  =  r(t  —  r)  <  f(0)  <  0,V£  >  r.  This  is  obviously  not 
possible.  So  it  follows  that  t\  is  finite.  Also  since  r(t\)  =  0,  and  q(t\  —  r)  =  r(t\  —  r)  <  0,  so  t\  >  r. 

For  £  >  t\,  and  r{t)  <  0,  we  have  f(£)  >  0  and  q(t  —  r)  <  0.  If  the  trajectory  of  xt  intersects  T  before  it 

intersects  the  q- axis,  we  know  that  at  the  intersection  the  trajectory  must  be  vertical  to  the  r-axis,  so  at  that  instance 
q  >  0,  which  is  contradictory,  xt  cannot  passes  (0,0)  since  local  stability  condition  forbids  this.  So  x /  does  not 
cross  the  q- axis  in  the  second  quadrant  of  (f,q)-plane. 

Next  we  show  xt  will  hit  r-axis  in  finite  time.  If  not  so,  thanks  to  the  monotonicity  of  fit)  and  q(t)  as  well  as 
the  boundedness  of  the  third  quadrant,  xt  will  converge  to  a  certain  (f .  q).  That  means  the  system  (13)  has  another 
equilibrium  state  other  than  (0, 0)  in  the  (f ,  (j)-plane,  which  is  impossible.  So  f  (£ )  will  become  positive  in  finite 
time.  We  denote  £2  =  min{£|f(£)  =  0,£  >  £1}  and  Ti(ip)  =  £2  +  t,  then  T\(ip)  is  continuous  and  xTl^(il’)  E  —K. 

Similarly  denote  £3  =  min{£|x(£)  E  T,  £  >  A }  and  we  can  show  that  Tj  is  finite.  This  is  because  dq/dt  is  strictly 
positive  for  t  E  \p2  +  r,  ^3] .  Use  the  same  reasoning  as  before  it  can  be  shown  that  x  /  can  not  first  cross  the  q-axis 
in  the  fourth  quadrant  for  t  >  £3.  It  is  left  to  be  shown  that  xt  reaches  q- axis  in  the  first  quadrant  in  finite  time. 
Here  we  can  utilize  the  actual  boundedness  of  q  shown  in  Lemma  4  and  monotonicities  of  r  and  q  in  the  first 
quadrant  to  prove  this.  Therefore  there  exits  a  finite  1 4  such  that  x(t±)  belongs  to  q-axis  and  TofU)  =  t±  +  r  is 
continuous  and  E  K.  ■ 

For  any  i/j  E  K  \  {0},  define  A:  K  \  {0}  — >  K  by 

Aip  =  xTlty)+T2(XTlWW)(i’)- 

We  need  to  prove  the  Condition  (iv)  of  Theorem  4.  We  only  show  the  mapping  T\  here,  and  due  to  symmetry, 
the  proof  of  T2  is  the  same. 

Lemma  6:  If  G  is  a  given  open  subset  of  M2,  0  E  G,  there  exists  a  neighborhood  V  of  0  in  C  such  that 
xt(-;  ip)  E  G,  for  any  ip  E  V  Cl  K,  ip  /  0,  and  any  t,  0  <  t  <  T\(ip). 

Proof:  Because  the  vector  field  of  (13)  is  continuous,  and  (0,  0)  is  the  equilibrium  point  of  the  equations,  we 
only  need  to  prove  that  xt(-',ip)  E  G,  for  0  <  t  <  t2(ip)  as  t2(ip)  defined  in  Lemma  5  (r^)  =  0).  Suppose  the 
claim  of  this  lemma  is  not  true,  we  will  later  show  a  contradiction.  Assume  there  exists  a  sequence  ipn  E  K  \  {0}, 
n  =  1, 2,  0,  as  n  — >  00,  such  that  there  is  a  rn,  0  <  rn  <  t2(ip)  +  r,  |r(rn)|  =  M,  or  |g(rn)|  =  N,  for 

some  given  positive  M,  N. 

From  smoothness  of  T,  we  know  for  any  small  e,  there  is  a  constant  a,  such  that  max{|f(t)|,  0  <  t  <  1 2 ("0) }  = 
f(f  1 )  |  <  (xq ( 0 ) ,  for  any  q(0)  <  e.  Then  consider  the  period  from  the  trajectory  crossing  the  f-axis  to  1 2,  we  have 

a  l~fr  (-T2cf(q’)t  -  -  T)) 

>  -Cf(q*)(l-6)r 


for  some  positive  constant  6  <  1,  and  (3.  The  last  inequality  is  due  to  the  negativity  of  q(t  —  r)  in  the  region  we 
consider.  Therefore,  we  get  the  upper  bound  of  \q(t2  —  t)|  as 


aq( 0)e  c^q  ^ dt 


aq(  0) 

Cf(q*)(l-5Y 


So  the  upper  bound  of  \q(t2)\  is  just  ct(r-F  (Cf(q*)(  1  —  5))  1)q(0)  for  small  enough  q(0).  Using  this  we  get  after 
some  calculations  for  £2  <  t  <  (2  +  t 


dr_  'ya(T  +  (Cf(q*)(l-6))  x) 
dt  ~  r2f(q*) 


for  some  positive  constant  7.  So  we  can  give  an  upper  bound  of  |r(£2  +  r)|  as 


7a(r  +  (Cf(q*)(l  —  <5))  :) 


9(0). 


rf{q*) 
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Therefore,  we  proved  for  sufficiently  small  g(0),  for  any  t  G  [0. T\  (ip)],  \xt(-\ip)\  never  hits  the  boundary  of 
{(x,y)  :  x  G  [0,M],  y  G  [0,  IV]},  for  any  positive  M,  N.  That  is  equivalent  to  the  argument  of  this  lemma.  ■ 
Lemma  7:  For  any  r  >  t\  and  positive  roots  A  defined  in  Lemma  2,  inf' { | tt > ci  :  <p  G  K,  |</>|  =  <5}  >  0  for  any 
5  >  0. 

Proof:  It  follows  from  Lemma  2  that  there  is  a  characteristic  root  A  with  positive  real  part  when  r  >  T0. 
Then  the  transposed  equations  of  Equations  (15)  are 


du(t) 

dt 

dv{t) 

dt 


TCf{q*)u(t)  -  rv(f) 

/V) 


rf(q*) 


u(t  +  1), 


and  the  bilinear  form  is 


<  (,ip  >=  b<p(0)  +  £(0 )a  - 


/V) 

Tf{q*) 


i{e  +  i)f{e)de 


'-i 


where  £  =  (£,&),  b  G  M,  £  G  (7([0, 1],M)  and  ip  =  (a,  0),  <p  G  C([— 1,  0],M),  a  G  M.  Since  for  any  <p  G  C, 
7T \(f>  =  <  E\,  f  >  where  Tu  and  LA  are  the  bases  of  generalized  eigenspace  of  Equations  (15)  and  its  adjoint 

respectively.  So  it  is  sufficient  to  check  <  >.  It  can  be  shown  that  the  basis  of  the  solutions  to  the  transposed 

equations  for  projection  vr  is 


Ci(«)  =  (~e  XiS,~(Cf(q*)  +  XiT  x)e  AiS),  *  =  1,2. 


Consider  A  =  n  +  its,  where  as  proved  in  Lemma  2,  fi  >  0  and  0  <  v  <  n.  The  real  and  imaginary  parts  of 

<  C,ip  >  are 


Re  <  (,  4>  >  = 


+ 

Im  <  e,  ip  >  = 

+ 


-( Cf{q*)  +  pr  )^>(0)  —  a 
/'(?*)  ^ 


rf(q*)  7_i 
—  0) 
f\q*) 
rf{q*)  J- 


e  cos  v{6  +  l)cj)(9)d9 


J  e-^e+1)smv(6  +  l)(l)(9)dd. 


If  there  is  a  sequence  f>n  =  (</>n,  an)  G  dB{  1)  fi  if  such  that  — >•  oo  as  n  — >  oo,  then  Im  <  >— >  0.  But 

from  the  form  of  Im  <  >  we  know  this  is  true  only  when  <jin()  |  — >  0.  This  together  with  Re  <  CV’n  0 

indicates  an  — ►  0  as  n  — >  oo.  So  — >  0  as  n  — >  oo  which  contradicts  the  assumption.  Therefore  the  second  claim 
also  holds.  ■ 

From  Lemma  3  and  4,  and  based  on  the  fact  that  the  solution  continuously  depends  on  initial  conditions,  we  get 
the  map  A  :  K  \  {0}  — >  K  defined  above  is  completely  continuous.  Also  it  is  obvious  from  boundedness  of  the 
solution  that  there  is  a  constant  M  >  0,  such  that  if  Ai/j  =  ip  &  K  \  {0},  \ip\  =  M,  then  v  <1.  Together  with 
the  results  in  Lemma  5,  6,  and  7,  applying  Theorems  3  and  4,  we  conclude 

Theorem  5:  If  marking  function  f(q)  satisfies  Conditions  (14)  and  t  >  t\  where  t\  is  given  in  Lemma  2, 
Equation  (13)  has  a  non-constant  periodic  solution. 
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